Storage Resource Managers: Middleware Components for Grid Storage
نویسندگان
چکیده
The amount of scientific data generated by simulations or collected from large scale experiments have reached levels that cannot be stored in the researcher’s workstation or even in his/her local computer center. Such data are vital to large scientific collaborations dispersed over wide-area networks. In the past, the concept of a Grid infrastructure [1] mainly emphasized the computational aspect of supporting large distributed computational tasks, and managing the sharing of the network bandwidth by using bandwidth reservation techniques. In this paper we discuss the concept of Storage Resource Managers (SRMs) as components that complement this with the support for the storage management of large distributed datasets. The access to data is becoming the main bottleneck in such “data intensive” applications because the data cannot be replicated in all sites. SRMs are designed to dynamically optimize the use of storage resources to help unclog this bottleneck.
منابع مشابه
Chapter 20 STORAGE RESOURCE MANAGERS Essential Components for the Grid
Storage Resource Managers (SRMs) are middleware components whose function is to provide dynamic space allocation and file management of shared storage components on the Grid. They complement Compute Resource Managers and Network Resource Managers in providing storage reservation and dynamic information on storage availability for the planning and execution of a Grid job. SRMs manage two types o...
متن کاملGrid tool integration within the eMinerals project
In this article we describe the eMinerals mini grid, which is now running in production mode. This is an integration of both compute and data components, the former build upon Condor, PBS and the functionality of Globus v2, and the latter being based on the combined use of the Storage Resource Broker and the CCLRC data portal. We describe how we have integrated the middleware components, and th...
متن کاملMySRB & SRB: Components of a Data Grid
Data Grids are becoming increasingly important in scientific communities for sharing large data collections and for archiving and disseminating them in a digital library framework. The Storage Resource Broker provides transparent virtualized middleware for sharing data across distributed, heterogeneous data resources separated by different administrative and security domains. The MySRB is a web...
متن کاملComposing and Deploying Grid Middleware Web Services Using Model Driven Architecture
Rapid advances in networking, hardware, and middleware technologies are facilitating the development and deployment of complex grid applications, such as large-scale distributed collaborative scientific simulation, analysis of experiments in elementary particle physics, distributed mission training and virtual surgery for medical instruction. These predominantly collaborative applications are c...
متن کاملCo-allocating Compute and Network Resources - Bandwidth on Demand in the Viola Testbed
Distributed applications or workflows need to access and use compute, storage and network resources simultaneously or chronologically coordinated respectively. Examples are distributed multi-physics simulations that use the combined computational performance and data storage of multiple clusters. A coordinated reservation and allocation of the resources is a prerequisite for the efficient use o...
متن کامل